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(57) Abstract: A haptic feedback 
remote control device provides 
control signals to a toy device. 
The remote control device 
includes: a housing (24), a 
layer of compliant foam (62), a 
rechargeable battery (60), and 
an actuator assembly (50). The 
layer of compliant foam (62) 
reduces the inertia] contribution 
of the battery (60) to the system 
and allows a user to feel stronger 
tactile sensations with the 
actuator assembly (50). 
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HAPTIC REMOTE CONTROL FOR TOYS 

m 

BACKGROUND OF THE INVENTION 

The present invention relates generally to the interfacing with remote devices by a user, 
5 and more particularly to devices used to interface with remote control toys and which provide 
haptic feedback to the user. 

Humans interface with electronic and mechanical devices in a variety of applications, and 
the need for a more natural, easy-to-use, and informative interface is a constant concern. In the 
context of the present invention, one such application is the remote control of moving devices 

10 such as toy vehicles. For example, remote control toy cars are common, which are small cars 
that move under their own power, e.g. using batteries or gasoline. The user may typically control 
the direction of turning, the braking, and/or the forward/back direction of the car by using a 
remote control unit, which typically sends signals to the car via wireless transmission. Some 
remote control toys with limited motion may include a wire connecting the remote control unit 

15 with the controlled toy or device to allow the signals to be transmitted to the toy. The remote 
control unit may include joysticks, dials, switches, buttons, or other controls to assist the user in 
the control of the toy. Other types of moving toys and devices can be similarly controlled, such 
as flying toys (e.g., planes, helicopters, rockets), water toys (e.g., boats and submarines), trucks, 
robots, toy animals, etc. 

20 One type of functionality missing from toy remote control devices is kinesthetic force 

feedback and/or tactile feedback, collectively known herein as "haptic feedback." Haptic 
feedback can be added to such interface control devices to provide the user with a more 
interactive experience and to provide greater ease in interfacing and controlling the remote toy 
device. 

25 SUMMARY OF THE INVENTION 

The present invention provides a haptic feedback remote control device for controlling 
moving toy devices such as cars, boats, etc. The remote control unit provides haptic feedback to 
the user that provides a more compelling experience when controlling the toy. 
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More particularly, a hap tic feedback remote control device provides control signals to a 
toy device, such as a car, boat, plane, etc., to control the operation of the toy device. The remote 
control device includes a housing and at least one control for manual manipulation by the user, 
where control signals representing the manipulation are sent to the toy device to control the 
operation of the toy device. An actuator outputs forces on the housing in response to received 
actuator signals, and a controller provides the actuator signals to the actuator and monitors the 
control signals representing the manipulation of the control. The controller can determine the 
forces based only on the manual manipulation of the control by the user, or based partially on the 
manipulation, In one embodiment, the actuator moves an inertial mass to provide inertial haptic 
sensations on the housing, the inertial haptic sensations being felt by the user. The control 
includes a lever movable along an axis, a steering wheel or knob, or other control. Preferably, 
the control signals sent to the toy device are transmitted wirelessly to the toy device. For 
example, the control can be a throttle control or steering control. 

An additional feature in some embodiments allows the controller to determines the forces 
based only or partially on information received from the toy device. For example, the 
information received from the toy device can includes information from a contact sensor on the 
toy device that indicates whether the toy device has contacted another object at a location of the 
contact sensor. The information can indicate a degree of contact of the toy device with the other 
object In another embodiment, the information can indicate an amount of acceleration 
experienced by the toy device in at least one dimension of the toy device. 

In another embodiment, an actuator in the remote control unit can output forces on the 
control manipulated by the user in response to the received electrical signals. The forces can be 
determined based only or partially on the local manipulation of the control(s), or partially or 
wholly on information indicating the status of the controlled toy. An embodiment of a remote 
control toy device includes a remote control unit as described above and a toy device operable to 
physically move in accordance with the control signals. Another embodiment is a method for 
controlling a toy device based on manipulation of a remote control unit by a user provide haptic 
sensations to the user. 

The present invention provides a haptic feedback remote control device that provides 
haptic sensations to the user when controlling a toy vehicle or other toy device. This allows the 
user to experience another dimension in sensory feedback when controlling a toy remotely. The 
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sensations can simulate what the toy is currently experiencing and can also inform the user of the 
status of the toy, thereby enhancing the user's control over the toy. 

These and other advantages of the present invention will become apparent to those 
skilled in the art upon a reading of the following specification of the invention and a study of the 
5 several figures of the drawing. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a perspective view of remote control system of the present invention, 
10 including a remote control unit and a toy device; 

Figure 2 is a side elevational cross-sectional view of the remote control unit of Fig. 1; 

Figure 3 is a perspective view of one embodiment of an actuator assembly suitable for 
use in the remote control unit of the present invention; 

Figure 4 is a perspective view of another embodiment of an actuator assembly suitable 
1 5 for use in the remote control unit of the present invention; 

Figure 5 is a side elevational view of the toy device of the present invention that includes 
an accelerometer for determining accelerations on the toy; 

Figure 6 is a perspective view of one embodiment of a lever on the remote control 
provided with kinesthetic force feedback by a motor; and 

20 Figure 7 is a block diagram illustrating the components of the remote control unit and the 

toy device of the present invention. 



DETAILED DES CRIPTION OF PREFERRED EMBODIMENTS 

In FIGURE 1, a remote control toy system 10 of the present invention is shown. 
25 Remote control toy system 10 includes a remote control 12 and a controlled toy 14. 



3 



* 1 



WO 2002/078810 PCT7US2002/0 10394 

Remote control 12 is operated by a user to control the toy 14. Remote control 12 is 
typically small enough to be held in one or both hands of the user and may include a variety of 
controls. For example, a joystick or lever 20 can be moved by the user up or down to command 
the toy 14 to move forward or back, respectively. In some rate control embodiments, the 
distance that the lever 20 is moved from an origin position (such as the center of the lever's 
range) controls the velocity of the controlled toy in the appropriate direction. Lever 22 can be 
moved left or right to command the toy to turn left or right, respectively. In some rate control 
embodiments, the distance that the lever 22 is moved from an origin position controls the 
amount or tightness of the turn of the toy. Other buttons, small steering wheels, knobs, dials, 
joysticks, trackballs, switches, direction pads, levers, or other controls can be included to 
command various other functions of the toy, such as to brake or stop the toy, power or start the 
toy, turn on headlights, change driving modes, sound a horn, etc. and/or to control steering and 
throttle functions instead of levers 20 and 22, and any of these controls can be provided with 
haptic feedback as described herein Some embodiments may provide the functionality of the 
remote control 12 in another device, such as a cell phone, portable computer (e.g. laptop or 
PDA), wristwatch, etc. 

Remote control 12 may include a wireless transmission device for transmitting control 
signals through the air to the toy 14. The implementation of such a transmission device is well 
known to those of skill in the art. Often, remote control 12 includes an antenna 23 to broadcast 
20 radio frequency (RF) (or other frequency range) control signals at a desired frequency. In other 
embodiments, the control signals from the remote control can be sent along a wire or other 
transmission line that physically couples the remote control 12 to the toy 14. Some 
embodiments may allow the remote control 12 to receive signals from the toy 14, as detailed 
below; in such embodiments, appropriate receiver electronics are included in the remote control 
25 12. 

In the present invention, remote control 12 includes haptic feedback functionality. This 
functionality can be provided using one or more actuators included within or coupled to the 
housing 24 of the remote control 12. Various embodiments of the haptic remote control are 
described in detail below. 

30 Toy 14 is shown in Fig. 1 as a remote controlled race car. Toy 14 can include chassis 

26, wheels 28, and antenna 30. Chassis 26 includes one or more motors (not shown) for causing 
the toy 14 to move, cause the wheels to turn, etc. In some embodiments, batteries are stored in 
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the chassis 26 to provide power to the motors; other embodiments may provide other power 
sources, such as liquid fuel (e.g. gasoline). Antenna 30 allows the toy 26 to receive the 
command signals sent wirelessly by the remote control 12. 

Toy 14 includes receiver electronics for receiving the commands from the remote 
5 control 12, e.g. at the proper broadcast frequency. In those embodiments in which information is 
transmitted to the remote control 12 from the toy 14, the toy 14 includes a transmitter, e.g. a 
wireless transmitter simil ar to the transmitter used by the remote control 12. Other components 
of the toy can include a microprocessor or other controller for implementing received commands, 
controlling the motors, reading sensors (for those embodiments including sensors), etc. 

10 Other types of moving toy vehicles and devices can be similarly controlled, such as 

flying toy vehicles (e.g., planes, helicopters, rockets), water toy vehicles (e.g., boats and 
submarines), trucks, robots, toy animals, etc. 

Local Haptic Sensation Embodiments 

15 FIGURE 2 is a side elevational view of a first embodiment of a remote control 12 of 

the present invention. In this embodiment, tactile feedback is provided to the user based on local 
actions taken by the user with the controls of the remote control 12. 

The housing 24 of the remote control 12 includes an actuator assembly 50 which 
outputs forces on the housing 24 of the remote control 12. In the described embodiment, 
20 actuator assembly 50 oscillates an inertial mass in an approximately linear motion. The 
oscillations provided by the movement of the inertial mass are transmitted to the housing 24, 
where the user contacting the housing feels them as tactile sensations. The inertial mass can 
preferably be oscillated at different frequencies and force magnitudes to provide a variety of 
tactile sensations, such as pulses and vibrations. 

25 One embodiment of an actuator assembly 50 is described below with reference to Fig. 

3, where the actuator itself is oscillated as an inertial mass. In other embodiments, other types of 
actuator assemblies can be used. For example, an eccentric mass can be coupled to an actuator 
shaft and rotated, as described below with reference to Fig. 4. Other embodiments can employ a 
linear voice coil actuator or moving magnet actuator to move a coil or a magnet, respectively, 

30 and produce inertial pulses or vibrations. Some inertial feedback embodiments are described in 
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U.S. Patent No. 6,211,861. In still other embodiments, the actuator can drive a member to 
impact the housing and cause tactile feedback from one or more such impacts. 

Other embodiments of the present invention can cause tactile feedback to a portion of 
the housing 24. For example, a portion of the housing can be made moveable with respect to the 
5 remaining portion of the housing. The moveable portion can be coupled to the actuator assembly 
and moved to provide tactile sensations. The moveable portion can be positioned at a location 
on the housing that is contacted by the user when holding, contacting or supporting the remote 
control 12 during normal use. In one embodiment, the moveable portion can be moved away 
from (e.g. perpendicular to) the outer surface of the stationary portion of the housing, such as a 
10 cover on a hinge, to move against the user's finger or palm. In other embodiments, the moveable 
portion can be moved laterally, parallel to the outer surface of the housing and in shear with the 
user's skin contacting the moveable portion (or both lateral and perpendicular motion can be 
provided). Some embodiments of a moveable surface portion are described in U.S. Patent No. 
6,184,868. 

15 A battery 60 or other power storage element can be included in the remote control 12 to 

supply power to the actuator assembly 50 and other components, such as a local microprocessor, 
transmitter, lights on the device, etc. Battery 60 can be the disposable form of battery, or a 
rechargeable battery which the user can remove, recharge, and replace. Some embodiments can 
provide a convenient compartment door in the housing 24 to allow easy access to the battery 60 

20 by the user. One or more batteries 60 can be provided in the remote control 12 for the desired 
amount of power. Other types of power storage elements that supply power may be used in other 
embodiments. In some embodiments, the battery 60 may be recharged without the user having to 
remove it from the device housing 24. For example, the housing 24 can include a "docking port" 
or electrical connector connected to a rechargeable battery 60 which allows the remote control 12 

25 to be plugged into a mating connector on a recharging power source device that is, for example, 
connected to a standard AC power outlet. 

Battery 60 can be a heavy component and thus may disadvantageous in an inertial 
haptic feedback device. The heaviness of the battery 60 can add to the overall mass of the 
device, which may weaken the strength of the inertial haptic sensations output by actuator 
30 assembly 50 and felt by the user. To compensate for this effect, a flexible or compliant coupling 
between the battery 60 and the housing 24. For example, a layer 62 of compliant foam can be 
placed between battery 60 and housing 24; other embodiments may use a rubber or other 
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compliant layer or spring element. Layer 62 allows the battery 60 to move at least partially 
independently of the housing 24, and thus inertially decouples the battery 60 from the housing 
24. The layer 62 reduces the inertial contribution of the battery 60 to the system and allows the 
user to feel stronger tactile sensations with the given actuator assembly 50 than if the battery 60 
5 were rigidly coupled to the housing without layer 62. 

FIGURE 3 is a perspective view of one embodiment 100 of the actuator assembly 50 for 
use in the remote control 12. Actuator assembly 100 includes a grounded flexure 120 and an 
actuator 110 coupled to the flexure 120. The flexure 120 can be a single, unitary piece made of a 
material such as polypropylene plastic ("living hinge" material) or other flexible material. 
10 Flexure 120 can be grounded to the mouse housing 24 of the remote control 12, for example, at 
portion 121. 

Actuator 1 10 is shown coupled to the flexure 120. The housing of the actuator is coupled 
to a receptacle portion 122 of the flexure 120 which houses the actuator 110 as shown. A 
rotating shaft 124 of the actuator is coupled to the flexure 120 in a bore 125 of the flexure 120 

15 and is rigidly coupled to a central rotating member 130. The rotating shaft 124 of the actuator is 
rotated about an axis B which also rotates member 130 about axis B. Rotating member 130 is 
coupled to a first portion 132a of an angled member 131 by a flex joint 134. The flex joint 134 
preferably is made very thin in the dimension it is to flex so that the flex joint 134 will bend 
when the rotating portion 130 moves the first portion 132a approximately linearly. The first 

20 portion 132a is coupled to the grounded portion 140 of the flexure by a flex joint 138 and the 
first portion 132a is coupled to a second portion 132b of the angled member by flex joint 142. 
The second portion 132b, in turn, is coupled at its other end to the receptacle portion 122 of the 
flexure by a flex joint 144. 

The angled member 131 that includes first portion 132a and second portion 132b moves 
25 linearly along the x-axis as shown by arrow 136. In actuality, the portions 132a and 132b move 
only approximately linearly. When the flexure is in its origin position (rest position), the 
portions 132a and 132b are preferably angled as shown with respect to their lengthwise axes. 
This allows the rotating member 130 to push or pull the angled member 131 along either 
direction as shown by arrow 136. 

30 The actuator 1 10 is operated in only a fraction of its rotational range when driving the 

rotating member 130 in two directions, allowing high bandwidth operation and high frequencies 
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of pulses or vibrations to be output To channel the compression or stretching of the flexure into 
the desired z-axis motion, a flex joint 152 is provided in the flexure portion between the 
receptacle portion 122 and the grounded portion 140. The flex joint 152 allows the receptacle 
portion 122 (as well as the actuator 110, rotating member 130, and second portion 132b) to move 
5 (approximately) linearly in the z-axis in response to motion of the portions 132a and 132b. A 
flex joint 150 is provided in the first portion 132a of the angled member 131 to allow the flexing 
about flex joint 152 in the z-direction to more easily occur. 

By quickly changing the rotation direction of the actuator shaft 124, the 
actuator/receptacle can be made to oscillate along the z-axis and create a vibration on the mouse 

10 housing with the actuator 110 acting as an inertial mass. Preferably, enough space is provided 
above and below the actuator to allow its range of motion without impacting any surfaces or 
portions of the mouse housing 24. In addition, the flex joints included in flexure 120, such as 
flex joint 152, act as spring members to provide a restoring force toward the origin position (rest 
position) of the actuator 110 and receptacle portion 132. In some embodiments, the stops can be 

15 included in the flexure 120 to limit the motion of the receptacle portion 122 and actuator 110 
along the z-axis. 

FIGURE 4 is a perspective view of another embodiment 170 of an actuator assembly 50 
suitable for use in the remote control 12 to provide tactile sensations to the user. Actuator 
assembly 170 includes an actuator 176, such as a DC motor, which includes a shaft 172 that 
20 rotates about an axis C, and an eccentric mass 174 that is rigidly coupled to the shaft 172 and 
thus rotates with the shaft about axis C. In one embodiment, the housing of the actuator 176 is 
coupled to the housing of the remote control 12, e.g. the actuator can be attached to the inside of 
the housing of the remote control. In other embodiments, the actuator can be coupled to a 
movable manipulandum, such as a joystick or mouse, or other member. 

25 Many different types and shapes of eccentric masses 174 can be used. A wedge- or pie- 

shaped eccentric can be used, as shown, where one end of the eccentric is coupled to the shaft 
172 so that most of the wedge extends to one side of the shaft. Alternatively, a cylindrical or 
other-shaped mass can be coupled to the shaft 172. The center of the mass 174 is positioned to 
be ofifeet from the axis of rotation C of the shaft 172, creating an eccentricity parameter that is 

30 determined by the distance between the axis of rotation of the shaft 172 and the center of mass of 
the mass 174. The eccentricity can be adjusted in different device embodiments to provide 
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stronger or weaker vibrations, as desired. Greater magnitude is generally obtained by changing 
the eccentricity if the motor is driven constantly in one direction. 

When the eccentric mass 1 74 is rotated by the motor 1 70, a vibration is induced in the 
motor and in any member coupled to the motor due to the off-balance motion of the mass. Since 
5 the housing of motor 176 is preferably coupled to a housing of the remote control 12, the 
vibration is transmitted to the user that is holding the housing. One or more of motors 176 can 
be included in a control 14 to provide vibrotactile or other haptic feedback; for example, two 
motors may be used to provide stronger magnitude vibrations and/or vibrations in two different 
directions. Other types of actuator assemblies may also be used, as disclosed in U.S. Patent No. 
10 6,184,868, such as a linear voice coil actuator, solenoid, moving magnet actuator, etc. 



Haptic Sensations 

Different types of haptic sensations can be output to the user in the local haptic 
sensation embodiment Since the haptic sensations are determined based only on the local 
15 actions of the user on the remote control 12, the sensations can be based on specific actions or 
controls manipulated by the user. 

Engine vibration: The actuator assembly 50 can be controlled to output haptic 
sensations that are meant to simulate the vibration of an engine in a vehicle. This vibration 
sensation can have a magnitude and/or frequency correlated to the position of a throttle control, 

20 such as lever 20 in Fig. 1, which controls the speed of the toy 14. For example, as the forward 
speed of the toy is increased, the magnitude and frequency of the imparted vibration sensation is 
increased. At high speeds of the toy, a high magnitude and high frequency vibration can be 
imparted to the user, while at low speeds, a soft "idling" sensation can be imparted. When the 
user moves the lever 20 to command the toy to move in reverse, a unique haptic sensation 

25 associated with the reverse direction can be output, e.g. a lower frequency vibration. 

Turning: Haptic sensations can be controlled to be correlated with the user 
manipulating controls to turn the toy 14. For example, left-right lever 22 can be used to turn the 
toy left or right In some embodiments, the amount of movement of the lever from the origin 
position controls the tightness of the turn; when the lever is fully left or right, the toy turns in its 
30 smallest turning radius. Vibrations can be output on the remote control 12 to indicate the 



9 



WO 2002/078810 PCT/US2002/010394 

tightness of the turn. For example, a wide turn can be associated with a lower-frequency 
vibration, while a tight turn can be associated with a higher-frequency vibration. In some 
embodiments, both the speed and turn controls can be used in the determination of a haptic 
sensation. For example, a fast, tight turn can cause sporadic pulses as haptic sensations, which 
5 simulate the feel of tires of the toy losing traction with the ground. 

Other sensations: Other controls on the remote control 12 can be associated with haptic 
sensations. If there is a braking control that commands the toy to apply brakes or slow down its 
motion, a vibration can be output during the braking. Horns, blinking lights, or other functions 
of the toy controlled from the remote control 12 can also be associated with different haptic 
10 sensations. 

Kinesthetic force feedback can also be output on the controls of the remote control, 
which is forces in one or more of the sensed degrees of freedom of a manipulandum. For 
example, a motor or other actuator can output forces in the degree of freedom of lever 20 and 22, 
in the degree of freedom of motion of a button or switch, in the rotary degree of freedom of a 
15 small steeling wheel or knob, etc. Some embodiments for providing such haptic feedback are 
described below with respect to Fig. 6. 

hi a kinesthetic force feedback embodiment, time-based haptic effects can be output in 
the degree of freedom of a control, similar to the tactile effects described above. For example, a 
vibration or jolt can be directly output on the lever 20 or 22 while the user is holding it when 
20 controlling the toy 14 in a desired manner. The magnitude and/or frequency of the jolt or 
vibration can be based on the position of the control in its degree of freedom, and/or can simulate 
engine rumble, turning radius, etc. 

Furthermore, more sophisticated haptic sensations can be output in the kinesthetic force 
feedback embodiment. For example, a spring sensation generated by an actuator can provide a 

25 restoring force to a lever to its origin position. A tight or high-magnitude spring can be output 
for a fast turn of the toy 14, while a loose, low-magnitude spring can be output for a slow turn to 
simulate driving conditions at those speeds. Detents in the lever (or other control) motion can be 
output to mark particular positions to the user, e.g. each V4 of the lever range moved provides a 
detent to let the user haptically know how fast he or she is controlling the car to move or how 

30 tight a turn is being controlled. The detents can be implemented as jolts, spring forces, or other 
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force profiles. A damping force can resist lever motion based on the velocity of lever motion. A 
barrier or obstruction force can prevent or resist motion of a control past a desired limit. 



Haptic Feedback Based or Informa tion from the Controlled Toy 

More sophisticated embodiments of the present invention are described below. In these 
embodiments, the toy 14 can send signals to the remote control 12 to inform the remote control 
of one or more statuses or conditions of the toy. The output of haptic sensations, and the 
characteristics of those haptic sensations (e.g., type of sensation, magnitude, frequency, duration, 
etc.), can be based solely or partially on these signals. 

In one embodiment, one or more sensors are mounted on the toy 14. For example, 
referring to Fig. 1, a sensor 32 can be mounted to the front bumper 33 of the car 14. When the 
car impacts or collides with an obstacle that is in the sensing range of the sensor 32, the sensor 
32 detects the collision and immediately relays status signals to the remote control 12 that the 
collision has occurred. In some embodiments, the sensor 32 can be an on/off sensor, detecting 
only whether a collision has occurred or not. In other embodiments, more sophisticated sensors 
can be used, such as analog sensors, which detect the strength of the collisions. 

The sensor 32 can be any of a variety of different types of sensors. For example, an 
optical sensor with emitter and detector, a magnetic sensor, a mechanical contact sensor, analog 
20 potentiometers that measure the motion of a contact member, or other types of sensors for 
detecting contact can be usedL Alternatively, or additionally, one or more sensors can be 
positioned at other areas of the toy to detect contact in those areas, such as at a rear bumper or 
other rear surface, a side surface, the underside of the toy, etc. 

The signals sent from the toy 14 to the remote control 12 can have the same broadcast 
25 carrier frequency as the signals transmitted from remote control to toy, or can have a different 
frequency. The remote control 12, upon receiving the signal from the toy, can command a tactile 
sensation appropriate to the signal. 

A variety of haptic sensations can be provided. If a collision is detected by the sensor 
32, the controller (see Fig. 7) can command a jolt, pulse, or vibration to the housing of the 
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remote control. The user thus feels haptic feedback correlated to what the toy is experiencing. 
This can be not only more entertaining for the user, but also useful in a variety of contexts. For 
example, if the toy moves out of the sight of the user and collides with a wall, the user can be 
informed hapticaUy and will know that the toy must be controlled in reverse to back away from 
5 the wall. If multiple sensors at different locations of the toy are being used, then a front collision 
can be associated with a different haptic sensation than a rear collision of the toy, a left side 
collision can be associated with a different haptic sensation than a right side collision, etc. For 
example, a front collision can be associated with a jolt or vibration having a high frequency 
and/or magnitude, while a rear collision can be associated with a jolt or vibration having a lower 

10 frequency and/or magnitude. If the remote control 12 includes multiple actuator assemblies 50, 
then the assemblies can be positioned in the remote control housing to correlate with locations 
on the toy. For example, one assembly can be positioned on the left side of the remote control, 
and the other assembly positioned on the right side. When the toy impacts something on its right 
side, the right actuator assembly can be controlled to output a jolt or vibration, so that the user 

1 5 feels a haptic sensation on the right side of the controller. 

In addition, the magnitude of the haptic sensations can be correlated with a speed of the 
toy that is assumed from the throttle control on the remote control 12. For example, if the lever 
20 has been pushed forward to its full extent, then it is assumed the toy is moving very fast and 
that when a collision occurs, it is a strong one. Thus, a high-magnitude jolt or vibration is 
20 output. If, on the other hand, the lever 20 is positioned only slightly away from its origin 
position when a collision is sensed by the sensor 32, a slow toy speed is assumed and a lower- 
magnitude sensation can be output on the remote control 12. 

In embodiments providing an analog sensor, force sensor, or variable-state sensor as 
sensor 32, different haptic sensations can be more realistically associated with different degrees 

25 of collision or contact as sensed by the sensors. For example, the sensor 32 can directly sense 
whether a collision is a strong one, and the magnitude of the correlated haptic sensation can be 
proportionally adjusted. Thus, a mid-strength collision can be associated with a haptic sensation 
having a magnitude in the middle of the available output range. This can provide a more 
realistic correlation between collision strength and haptic sensation strength, since a speed of the 

30 toy is not assumed, and an actual collision strength is measured. 

Haptic sensations can also be based on a combination of toy status, as relayed by the 
sensor(s) 32, and user manipulation of a manipulandum or control on the remote control 12. For 

12 



I 

I » 



I * 1 



WO 2002/078810 PCT/US2002/0 10394 

example, a centering spring force output in the degree of freedom of a steering wheel or knob on 
remote control 12 can be based on the current position of that wheel or knob, and can be 
combined with a jolt force that is output based on a sensed collision of the toy with another 
object 

5 FIGURE 5 is a side elevational view of a toy vehicle 200 similar to the toy 14 of Fig. 1, 

but has been modified to provide signals to the remote control 12. Toy 200 includes an inertial 
sensor 202 (e.g., an accelerometer) which can sense the accelerations to which the toy 200 is 
subject. 

Such inertial sensors can take a variety of different embodiments. For example, Inertial 
10 sensor 202 can be a lower-cost single-axis accelerometer that can measure accelerations in only 
one axis. This type of sensor can be placed to sense only front-back, top-bottom, or side-to-side 
accelerations, if desired. Alternatively, this type of accelerometer can be positioned in toy 200 at 
an angle, as shown in Fig. 5, so it can sense both vertical (top-bottom) and front-back 
accelerations. For example, placing the accelerometer at a 45 -degree angle allows sensing in 
15 both these dimensions/axes (where a controller such as a local microprocessor can interpret the 
signals from the accelerometer to determine which accelerations are occurring in which 
dimensions). The sensor can be positioned at other angles to measure accelerations in other 
dimensions. In higher-cost embodiments, multi-axis accelerometers can be used to provide 
separate signals for each sensed dimension. 

20 Use of the accelerometer allows the user to feel haptic sensations that can be correlated 

with a variety of interactions that the toy is experiencing. For example, the accelerometer can 
sense and send status signals and data to the remote control representative of accelerations on the 
toy indicating the toy is bouncing over rough terrain or down stairs, landing after jumping off a 
ramp, or sideswiping another toy or object. Different haptic sensations can be output on the 

25 remote control 12 which simulate or indicate all of these conditions on the toy. 

The accelerometer can also be used in conjunction with multiple actuator assemblies 50 
placed at different locations on the remote control 12, as described above. For example, sensed 
accelerations of the car in a front-back axis can cause actuator assemblies positioned at the front 
and back of the remote control 12 to output haptic sensations in correlation with the sensed 
30 accelerations. Left/right actuator assemblies can similarly provide left/right differentiation to the 
user. 
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FIGURE 6 is a perspective view of one example embodiment 230 for a kinesthetic 
force feedback implementation of the remote control 12. Up/down lever 20 is shown coupled by 
a shaft 234 to a rotary actuator 232, which can be a DC motor, for example, or other type of 
actuator. The actuator 232 can output forces in the rotary degree of freedom of the lever 20 as 
controlled by actuator signals from a local controller such as a microprocessor. In addition, a 
sensor can be coupled to the same shaft 234 to determine the position of the lever 20 in its 
degree of freedom. A similar actuator can be coupled to lever 22 to drive that lever in its left- 
right degree of freedom. 

Other embodiments can employ different types of actuators, such as voice coil 
actuators, moving magnet actuators, brushed or brushless motors, etc. Also, some embodiments 
can provide passive actuators that output a resistance on the lever, but cannot output an active 
force on the lever, such actuators include magnetic particle brakes, fluid brakes, or other brake- 
like devices. 

Other controls on the remote control 230 can be similarly provided with kinesthetic 
force feedback. Buttons, for example, can be coupled to actuators to output forces in the degree 
of freedom of the button, as disclosed in U.S Patent No. 6,184,868. Knobs, dials, linear sliders 
or switches, steering wheels, trackballs, direction pads, joysticks and other controls can also be 
actuated. 

Kinesthetic force feedback on the controls of the remote control can offer greater 
realism to experienced haptic effects. For example, spring forces can be output on the levers 20 
and 22 to provide a centering function without having to use mechanical springs. Furthermore, 
when the toy is moving faster, the spring magnitude can be controlled to be higher to simulate 
the increased road forces on the steering of the car. In addition, if a local sensor such as an 
accelerometer detects that the car is airborne, the spring magnitude can be made zero to simulate 
the feel of light steering when the car loses contact with the road. When the car is experiencing a 
bumpy or rough terrain, the accelerometers on the car can provide the data back to the remote 
control to cause vibration or other forces on the lever that simulates the bumpiness and may 
cause some difficulty to the user in steering the toy. 

FIGURE 7 is a block diagram illustrating a haptic feedback remote control device 12 and 
toy device 14 of the present invention. Remote control 12 and toy 14 can be any of the described 
embodiments herein. 
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As explained above, toy device 14 can include electronic components for receiving 
signals and controlling motion of the toy. In some embodiments, the toy device 14 may include 
a processor 300, such as a microprocessor or other controller (hardware state machines, digital 
logic, an ASIC, etc.), which can receive sensor signals from sensor 32 (if a sensor is included on 
5 the toy) and which can output signals to control any output devices 302, such as motors that turn 
the front wheels for steering, wheel motors or other motors providing locomotion of the toy, any 
audio output devices such as a hom, and any visual output devices such as lights. In other 
embodiments, circuitry other than a processor 300 can be used for providing signals to output 
devices 302 and receiving signals from sensors 32 can be provided; for example, an analog 
10 control system can receive the signals from the remote control to drive the appropriate motors of 
the toy 14. An ASIC, state machines, or other logic can also be used. Any other required 
components for use with processor 300 may also be included, such as memory, I/O circuitry, etc. 

Processor 300 of the toy device 14 has a communication linlr 306 with the remote control 
device 12, as explained above. This link can be wireless through the use of RF or signals of 
15 other frequencies, or through a wire or other physical connection. In some embodiments, the 
link in one way, from the remote control device 12 to the toy 14. In other embodiments, the link 
is bi-directional. 

The haptic feedback remote control device 12 may include a local processor 310 which 
handles the input, output, and control functions of the remote control. The local processor 310 

20 can be provided with software (firmware) instructions to monitor the controls of the remote 
control device 12, wait for information sent from the toy device 14, and provide signals to the 
actuators of the remote control device to control haptic sensations. Processor 330 can include 
one microprocessor chip, or multiple processors and/or co-processor chips. In other 
embodiments, microprocessor 330 can include digital signal processor (DSP) functionality, or be 

25 implemented as control logic components, and ASIC, or hardware state machine instead of an 
actual microprocessor chip. 

A local clock 312 can be coupled to the processor 330 to provide timing data which 
might be required, for example, to compute forces output by actuators of the remote control 12. 
Local memory 314, such as RAM and/or ROM, can be coupled to processor 310 to store 
30 instructions for processor 310 and store temporary and other data. 
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Sensor interface 316 may optionally be included in device 12 to convert sensor signals to 
signals that can be interpreted by the processor 310. For example, sensor interface 316 can 
receive and convert signals from a digital sensor such as an encoder or from an analog sensor 
using an analog to digital converter (ADC). Such circuits, or equivalent circuits, are well known 
5 to those skilled in the art. Alternately, processor 310 can perform these interface functions. 

Sensors 318 sense the position, motion, and/or other characteristics of particular controls 
of remote control device 12; for example, sensors 318 can sense the motion or position of levers 
20 and 22 and any other buttons, switches, joysticks, trackballs, etc. on the remote control 12. 
Sensors 318 provide signals to processor 310 including information representative of that motion 
10 or position. Example of sensors suitable for embodiments described herein are analog 
potentiometers, Hall effect sensors, digital rotary optical encoders, linear optical encoders, 
optical sensors such as a lateral effect photo diode, velocity sensors (e.g., tachometers) and/or 
acceleration sensors (e.g., accelerometers) . Furthermore, either relative or absolute sensors can 
be employed. 

15 Actuator interface 320 can be optionally connected between the actuators of remote 

control device 12 and processor 310 to convert signals from microprocessor 310 into signals 
appropriate to drive the actuators. Interface 320 can include power amplifiers, switches, digital 
to analog controllers (DACs), and other components well known to those skilled in the art. 

Actuators 322 transmit forces, as described above, to the housing of the remote control 
20 12 and/or particular controls 324 of remote control device 12 in one or more directions along one 
or more degrees of freedom in response to signals output by processor 310, i.e., they are 
"computer controlled." Actuators 322 can include the actuator assembly 50 or rotary actuator 
234 described above. The actuators can a variety of devices, such as linear current control 
motors, stepper motors, pneumatic/hydraulic active actuators, a torquer (motor with limited 
25 angular range), magnetic particle brakes, friction brakes, or pneumatic/hydraulic passive 
actuators. 

Power supply 326 can be coupled to actuator interface 320 and/or to actuators 322 to 
provide electrical power to the actuator and other components of the remote control 12. As 
described above, power supply 326 is preferably batteries or other portable power supply. 

30 Other input devices 328 can be included in device 12 and send input signals to 

microprocessor 310. Such input devices can include other buttons, dials, knobs, switches, voice 
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recognition hardware, or other input mechanisms as described above. A safety or "deadman" 
switch can be included in some embodiments to provide a mechanism to allow a user to override 
and deactivate forces output by actuators 322. 

The operation of the system is now generally described. In the simpler, lower-cost 
5 embodiment, the sensors 318 can detect motion of controls such as levers 20 and 22 by the user 
and send the appropriate signals to the processor 310. The processor 310 then sends the 
appropriate control signals to the toy device 14 to control it in accordance with the user 
manipulation of the controls. The processor 310 also sends actuator signals to the actuator 
assembly(ies) 50 to output haptic sensations in accordance with the control manipulated and the 

10 way that control is manipulated. In the more sophisticated embodiments, the toy device 14 can 
send signals to the remote control 12. In those embodiments, the local processor 310 receives 
signals from local sensors 318 as well as information from the sensors 32 on the toy device 14. 
The local processor then determines the haptic sensations to be output and controls the actuators 
322 accordingly, as well as sending control signals to the toy device in accordance with the 

1 5 present user manipulation of the remote control 12. 

While this invention has been described in terms of several preferred embodiments, it is 
contemplated that alterations, permutations, and equivalents thereof will become apparent to 
those skilled in the art upon a reading of the specification and study of the drawings. 
Furthermore, certain terminology has been used for the purposes of descriptive clarity, and not to 
20 limit the present invention. It is therefore intended that the following appended claims include 
all such alterations, permutations and equivalents as fall within the true spirit and scope of the 
present invention. 

What is claimed is: 
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CLAIMS 

1. A haptic feedback remote control device for providing control signals to a toy device 
to control the operation of said toy device, the control device comprising: 

a housing; 

at least one control for m^nal manipulation by said user, wherein said control signals 
representing said manipulation are sent to said toy device to control said operation of said toy 
device; 

an actuator coupled to said housing, said actuator outputting forces on said housing or 
said at least one control in response to received actuator signals, wherein said actuator moves an 
inertial mass to provide inertial haptic sensations on said housing, said inertial haptic sensations 
being felt by said user, and 

a controller electrically coupled to said actuator, said controller providing said actuator 
signals to said actuator and monitoring said control signals representing said manipulation of 
said at least one control, wherein said controller determines said actuator signals based at least in 
part on said manual manipulation of said at least one control by said user. 

2. A haptic feedback remote control device as recited in claim 1 wherein said controller 
determines said actuator signals based only on said manual manipulation of said at least one 
control by said user. 

3. A haptic feedback remote control device as recited in claim 1 wherein said control 
signals sent to said toy device are transmitted wirelessly to said toy device. 

4. A haptic feedback remote control device as recited in claim 1 wherein said controller 
determines said actuator signals also based on information received from said toy device. 

5. A haptic feedback remote control device as recited in claim 4 wherein said 
information received from said toy device includes information from a contact sensor on said toy 
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device, said infonnation indicating whether said toy device has contacted with another object at a 
location of said contact sensor. 



6. A haptic feedback remote control device as recited in claim 5 wherein said 
information indicates a degree of contact of said toy device with said other object. 

7. A haptic feedback remote control device as recited in claim 4 wherein said 
information indicates an amount of acceleration experienced by said toy device in at least one 
dimension of said toy device. 

8. A haptic feedback remote control device as recited in claim 1 wherein said at least one 
control manipulated by said user includes a throttle control that determines a speed of travel of 
said toy device, wherein a magnitude of said forces is correlated with a setting of said throttle 
control. 

9. A haptic feedback remote control device as recited in claim 1 wherein said at least one 
control manipulated by said user includes a turning control that determines a direction of travel 
of said toy device, wherein a magnitude or frequency of said forces is correlated with a setting of 
said turning control. 

10. A haptic feedback remote control device as recited in claim 1 wherein said toy 
device is a toy vehicle capable of moving. 

11. A haptic feedback remote control device for providing control signals to a toy device 
to control the operation of said toy device, the control device comprising: 

a housing; 

at least one control for manual manipulation by said user, wherein said control signals 
representing said manipulation are sent to said toy device to control said operation of said toy 
device, wherein said at least one control includes a throttle control that determines a speed of 
travel of said toy device; 

an actuator coupled to said housing, said actuator outputting forces on said housing or 
said at least one control in response to received actuator signals; and 



19 



1 • 



WO 2002/078810 PCTYUS2002/0 10394 

a controller electrically coupled to said actuator, said controller providing said actuator 
signals to said actuator and monitoring said control signals representing said manipulation of 
said at least one control, wherein said controller determines said actuator signals based at least in 
part on said manual manipulation of said at least one control by said user, and wherein a 
. 5 magnitude of said forces is correlated with a setting of said throttle control 

12. A haptic feedback remote control device as recited in claim 11 wherein said 
controller determines said actuator signals based only on said manual manipulation of said at 
least one control by said user. 

10 13. A haptic feedback remote control device as recited in claim 11 wherein said 

controller determines said actuator signals also based on information received from said toy 
device. 

14. A haptic feedback remote control device as recited in claim 13 wherein said 
information received from said toy device includes information from a contact sensor on said toy 

1 5 device, said information indicating whether said toy device has contacted with another object at a 
location of said contact sensor. 

15. A haptic feedback remote control device for providing control signals to a toy device 
to control the operation of said toy device, the control device comprising: 

20 a housing; 

at least one control for manual manipulation by said user, wherein said control signals 
representing said manipulation are sent to said toy device to control said operation of said toy 
device; 

an actuator coupled to said at least one control, said actuator outputting forces on said 
25 housing or said at least one control in response to received actuator signals; and 

a controller electrically coupled to said actuator, said controller providing said actuator 
signals to said actuator and monitoring said control signals representing said manipulation of 
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said at least one control, wherein said controller determines said actuator signals based at least in 
part on information received from said toy device. 

16. A haptic feedback remote control device as recited in claim 15 wherein said 
5 controller determines said forces based at least in part on said manual manipulation of said at 

least one control by said user. 

17. A haptic feedback remote control device as recited in claim 15 wherein said actuator 
outputs inertia! forces on said housing by moving an inertial mass. 

18. A haptic feedback remote control device as recited in claim 15 wherein said at least 
10 one control includes a lever movable in one degree of freedom, wherein said actuator outputs 

forces in said degree of freedom. 

19. A haptic feedback remote control device as recited in claim 15 wherein said 
controller determines said forces also based on information received from said toy device. 

20. A haptic feedback remote control device as recited in claim 19 wherein said 
15 information received from said toy device includes information from a contact sensor on said toy 

device, said information indicating whether said toy device has contacted with another object at a 
location of said contact sensor. 

21. A haptic feedback remote control device as recited in claim 19 wherein said 
information indicates an amount of acceleration experienced by said toy device in at least one 

20 dimension of said toy device. 

22. A haptic feedback remote control device as recited in claim 15 wherein said toy 
device is a toy vehicle capable of moving. 

23. A haptic feedback remote control device for providing control signals to a toy device 
25 to control the operation of said toy device, the control device comprising: 

housing means; 
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at least one control means for manual manipulation by said user, wherein said control 
signals representing said manipulation are sent to said toy device to control said operation of said 
toy device; 

actuation means for outputting forces on said housing means or said control means in 
response to received actuator signals; and 

control means for providing said actuator signals to said actuator and for monitoring said 
control signals representing said manipulation of said at least one control, wherein said controller 
determines said actuator signals based at least in part on said manual manipulation of said at , 
least one control means. 

24. A haptic feedback remote control device as recited in claim 23 wherein said control 
means determines said actuator signals also based on information received from said toy device. 

25. A haptic feedback remote control device as recited in claim 23 wherein said control 
means determines said actuator signals only based on said manual manipulation of said at least 
one control means. 

26. A haptic feedback remote control device as recited in claim 23 wherein said 
information received from said toy device includes information from contact sensor means on 
said toy device, said information indicating whether said toy device has contacted with another 
object at a location of said contact sensor means. 

27. A remote control toy device providing haptic feedback to a user, the toy device 
comprising: 

a remote control unit for providing control signals, said remote control unit including: 
a housing, 

a control manually manipulable by said user, 

an actuator coupled to said housing, said actuator outputting forces on said 
housing or on said control in response to received actuator signals, and 
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a controller operative to provide said actuator signals to said actuator and to 
monitor said control signals representing said manipulation of said at least one control; 
and 

a toy device operable to physically move in accordance with said control signals received 
from said remote control unit 

28. A remote control toy device as recited in claim 27, wherein said controller 
determines said actuator signals based at least in part on said manual manipulation of said 
control. 

29. A remote control toy device as recited in claim 27 wherein said toy device further 
includes a sensor for detennining an interaction or action of said toy device, wherein information 
representative of said interaction or action is sent to said remote control unit. 

30. A remote control toy device as recited in claim 29 wherein said sensor detects 
contact of said toy device with another object, wherein said information informs said remote 
control unit of said contact 

31. A remote control toy device as recited in claim 30 wherein said sensor detects a 
degree of contact of said toy device with another object, wherein said information informs said 
remote control unit of said degree of contact. 

32. A remote control toy device as recited in claim 29 wherein said sensor is an 
accelerometer that detects an acceleration on said toy device, wherein said information informs 
said remote control unit of said acceleration. 

33. A method for controlling a toy device based on manipulation of a remote control unit 
by a user and for providing haptic sensations to the user, the method comprising: 

providing control signals to said toy device based on manual manipulation of at least one 
control on said remote control unit by said user, wherein said control signals control the 
operation of said toy device; 
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receiving status signals from said toy device, said status signals indicating a current status 
of said toy device; and 

causing haptic sensations to be output on said remote control unit, said haptic sensations 
based on at least one of said manual manipulation of said at least one control and said status 
signals received from said toy device. 



34. A method as recited in claim 33 wherein said actuator moves an inertial mass to 
provide inertial haptic sensations on a housing of said remote control unit. 

35. A method as recited in claim 33 wherein said at least one control includes a lever 
movable along an axis. 

36. A method as recited in claim 33 wherein said control signals sent to said toy device 
and said status signals received from said toy device are communicated wirelessly. 

37. A method as recited in claim 33 wherein said status signals received from said toy 
device include information from a contact sensor on said toy device, said information indicating 
whether said toy device has contacted with another object at a location of said contact sensor. 

38. A method as recited in claim 33 wherein said status signals received from said toy 
device include information indicating an amount of acceleration experienced by said toy device 
in at least one dimension of said toy device. 
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(57) Abstract: A haptic feedback remote control device provides control signals to a toy device. The remote control device includes: 
a housing (24), a layer of compliant foam (62), a rechargeable battery (60), and an actuator assembly (50). The layer of compliant 
foam (62) reduces the inertial contribution of the battery (60) to the system and allows a user to feel stronger tactile sensations with 
the actuator assembly (50). 
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HAPTfr REMOTE CONTROL FOR TOYS 



BACKGROUND OF THE INVENTION 

The present invention relates generally to the interfacing with remote devices by a user, 
5 and more particularly to devices used to interface with remote control toys and which provide 
haptic feedback to the user. 

Humans interface with electronic and mechanical devices in a variety of applications, and 
the need for a more natural, easy-to-use, and informative interface is a constant concern. In the 
context of the present invention, one such application is the remote control of moving devices 

10 such as toy vehicles. For example, remote control toy cars are common, which are small cars 
that move under their own power, e.g. using batteries or gasoline. The user may typically control 
the direction of turning, the braking, and/or the forward/back direction of the car by using a 
remote control unit, which typically sends signals to the car via wireless transmission. Some 
remote control toys with limited motion may include a wire connecting the remote control unit 

1 5 with the controlled toy or device to allow the signals to be transmitted to the toy. The remote 
control unit may include joysticks, dials, switches, buttons, or other controls to assist the user in 
the control of the toy. Other types of moving toys and devices can be similarly controlled, such 
as flying toys (e.g., planes, helicopters, rockets), water toys (e.g., boats and submarines), trucks, 
robots, toy animals, etc. 

20 One type of functionality missing from toy remote control devices is kinesthetic force 

feedback and/or tactile feedback, collectively known herein as "haptic feedback." Haptic 
feedback can be added to such interface control devices to provide the user with a more 
interactive experience and to provide greater ease in interfacing and controlling the remote toy 
device. 

25 SUMMARY OF THE INVENTION 

The present invention provides a haptic feedback remote control device for controlling 
moving toy devices such as cars, boats, etc. The remote control unit provides haptic feedback to 
the user that provides a more compelling experience when controlling the toy. 
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More particularly, a haptic feedback remote control device provides control signals to a 
toy device, such as a car, boat, plane, etc., to control the operation of the toy device. The remote 
control device includes a housing and at least one control for manual manipulation by the user, 
where control signals representing the manipulation are sent to the toy device to control the 
5 operation of the toy device. An actuator outputs forces on the housing in response to received 
actuator signals, and a controller provides the actuator signals to the actuator and monitors the 
control signals representing the manipulation of the control. The controller can determine the 
forces based only on the manual manipulation of the control by the user, or based partially on the 
manipulation. In one embodiment, the actuator moves an inertial mass to provide inertial haptic 
10 sensations on the housing, the inertial haptic sensations being felt by the user. The control 
includes a lever movable along an axis, a steering wheel or knob, or other control. Preferably, 
the control signals sent to the toy device are transmitted wirelessly to the toy device. For 
example, the control can be a throttle control or steering control. 

An additional feature in some embodiments allows the controller to determines the forces 
15 based only or partially on information received from the toy device. For example, the 
information received from the toy device can includes information from a contact sensor on the 
toy device that indicates whether the toy device has contacted another object at a location of the 
contact sensor. The information can indicate a degree of contact of the toy device with the other 
object. In another embodiment, the information can indicate an amount of acceleration 
20 experienced by the toy device in at least one dimension of the toy device. 

In another embodiment, an actuator in the remote control unit can output forces on the 
control manipulated by the user in response to the received electrical signals. The forces can be 
determined based only or partially on the local manipulation of the control(s), or partially or 
wholly on information indicating the status of the controlled toy. An embodiment of a remote 
25 control toy device includes a remote control unit as described above and a toy device operable to 
physically move in accordance with the control signals. Another embodiment is a method for 
controlling a toy device based on manipulation of a remote control unit by a user provide haptic 
sensations to the user. 

The present invention provides a haptic feedback remote control device that provides 
30 haptic sensations to the user when controlling a toy vehicle or other toy device. This allows the 
user to experience another dimension in sensory feedback when controlling a toy remotely. The 
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sensations can simulate what the toy is currently experiencing and can also inform the user of the 
status of the toy, thereby enhancing the user's control over the toy. 

These and other advantages of the present invention will become apparent to those 
skilled in the art upon a reading of the following specification of the invention and a study of the 
5 several figures of the drawing. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a perspective view of remote control system of the present invention, 
10 including a remote control unit and a toy device; 

Figure 2 is a side elevational cross-sectional view of the remote control unit of Fig. 1; 

Figure 3 is a perspective view of one embodiment of an actuator assembly suitable for 
use in the remote control unit of the present invention; 

Figure 4 is a perspective view of another embodiment of an actuator assembly suitable 
1 5 for use in the remote control unit of the present invention; 

Figure 5 is a side elevational view of the toy device of the present invention that includes 
an accelerometer for determining accelerations on the toy; 

Figure 6 is a perspective view of one embodiment of a lever on the remote control 
provided with kinesthetic force feedback by a motor; and 

20 Figure 7 is a block diagram illustrating the components of the remote control unit and the 

toy device of the present invention. 



DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

In FIGURE 1, a remote control toy system 10 of the present invention is shown. 
25 Remote control toy system 10 includes a remote control 12 and a controlled toy 14. 
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Remote control 12 is operated by a user to control the toy 14. Remote control 12 is 
typically small enough to be held in one or both hands of the user and may include a variety of 
controls. For example, a joystick or lever 20 can be moved by the user up or down to command 
the toy 14 to move forward or back, respectively. In some rate control embodiments, the 
5 distance that the lever 20 is moved from an origin position (such as the center of the lever's 
range) controls the velocity of the controlled toy in the appropriate direction. Lever 22 can be 
moved left or right to command the toy to turn left or right, respectively. In some rate control 
embodiments, the distance that the lever 22 is moved from an origin position controls the 
amount or tightness of the turn of the toy. Other buttons, small steering wheels, knobs, dials, 

10 joysticks, trackballs, switches, direction pads, levers, or other controls can be included to 
command various other functions of the toy, such as to brake or stop the toy, power or start the 
toy, turn on headlights, change driving modes, sound a horn, etc. and/or to control steering and 
throttle functions instead of levers 20 and 22, and any of these controls can be provided with 
haptic feedback as described herein Some embodiments may provide the functionality of the 

15 remote control 12 in another device, such as a cell phone, portable computer (e.g. laptop or 
PDA), wristwatch, etc. 

Remote control 12 may include a wireless transmission device for transmitting control 
signals through the air to the toy 14. The implementation of such a transmission device is well 
known to those of skill in the art. Often, remote control 12 includes an antenna 23 to broadcast 

20 radio frequency (RF) (or other frequency range) control signals at a desired frequency. In other 
embodiments, the control signals from the remote control can be sent along a wire or other 
transmission line that physically couples the remote control 12 to the toy 14. Some 
embodiments may allow the remote control 12 to receive signals from the toy 14, as detailed 
below; in such embodiments, appropriate receiver electronics are included in the remote control 

25 12. 

In the present invention, remote control 12 includes haptic feedback functionality. This 
functionality can be provided using one or more actuators included within or coupled to the 
housing 24 of the remote control 12. Various embodiments of the haptic remote control are 
described in detail below. 

30 Toy 14 is shown in Fig. 1 as a remote controlled race car. Toy 14 can include chassis 

26, wheels 28, and antenna 30. Chassis 26 includes one or more motors (not shown) for causing 
the toy 14 to move, cause the wheels to turn, etc. In some embodiments, batteries are stored in 
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the chassis 26 to provide power to the motors; other embodiments may provide other power 
sources, such as liquid fuel (e.g. gasoline). Antenna 30 allows the toy 26 to receive the 
command signals sent wirelessly by the remote control 12. 

Toy 14 includes receiver electronics for receiving the commands from the remote 
5 control 12, e.g. at the proper broadcast frequency. In those embodiments in which information is 
transmitted to the remote control 12 from the toy 14, the toy 14 includes a transmitter, e.g. a 
wireless transmitter similar to the transmitter used by the remote control 12. Other components 
of the toy can include a microprocessor or other controller for implementing received commands, 
controlling the motors, reading sensors (for those embodiments including sensors), etc. 

10 Other types of moving toy vehicles and devices can be similarly controlled, such as 

flying toy vehicles (e.g., planes, helicopters, rockets), water toy vehicles (e.g., boats and 
submarines), trucks, robots, toy animals, etc. 

Local Haptic Sensation Embodiments 

15 FIGURE 2 is a side elevational view of a first embodiment of a remote control 12 of 

the present invention. In this embodiment, tactile feedback is provided to the user based on local 
actions taken by the user with the controls of the remote control 12. 

The housing 24 of the remote control 12 includes an actuator assembly 50 which 
outputs forces on the housing 24 of the remote control 12. In the described embodiment, 
20 actuator assembly 50 oscillates an inertial mass in an approximately linear motion. The 
oscillations provided by the movement of the inertial mass are transmitted to the housing 24, 
where the user contacting the housing feels them as tactile sensations. The inertial mass can 
preferably be oscillated at different frequencies and force magnitudes to provide a variety of 
tactile sensations, such as pulses and vibrations. 

25 One embodiment of an actuator assembly 50 is described below with reference to Fig. 

3, where the actuator itself is oscillated as an inertial mass. In other embodiments, other types of 
actuator assemblies can be used. For example, an eccentric mass can be coupled to an actuator 
shaft and rotated, as described below with reference to Fig. 4. Other embodiments can employ a 
linear voice coil actuator or moving magnet actuator to move a coil or a magnet, respectively, 

30 and produce inertia! pulses or vibrations. Some inertial feedback embodiments are described in 



5 



WO 02/078810 PCTAJS02/10394 

U.S. Patent No. 6,211,861. In still other embodiments, the actuator can drive a member to 
impact the housing and cause tactile feedback from one or more such impacts. 



Other embodiments of the present invention can cause tactile feedback to a portion of 
the housing 24. For example, a portion of the housing can be made moveable with respect to the 
5 remaining portion of the housing. The moveable portion can be coupled to the actuator assembly 
and moved to provide tactile sensations. The moveable portion can be positioned at a location 
on the housing that is contacted by the user when holding, contacting or supporting the remote 
control 12 during normal use. In one embodiment, the moveable portion can be moved away 
from (e.g. perpendicular to) the outer surface of the stationary portion of the housing, such as a 
10 cover on a hinge, to move against the user's finger or palm. In other embodiments, the moveable 
portion can be moved laterally, parallel to the outer surface of the housing and in shear with the 
user's skin contacting the moveable portion (or both lateral and perpendicular motion can be 
provided). Some embodiments of a moveable surface portion are described in U.S. Patent No. 
6,184,868. 

15 A battery 60 or other power storage element can be included in the remote control 12 to 

supply power to the actuator assembly 50 and other components, such as a local microprocessor, 
transmitter, lights on the device, etc. Battery 60 can be the disposable form of battery, or a 
rechargeable battery which the user can remove, recharge, and replace. Some embodiments can 
provide a convenient compartment door in the housing 24 to allow easy access to the battery 60 

20 by the user. One or more batteries 60 can be provided in the remote control 12 for the desired 
amount of power. Other types of power storage elements that supply power may be used in other 
embodiments. In some embodiments, the battery 60 may be recharged without the user having to 
remove it from the device housing 24. For example, the housing 24 can include a "docking port" 
or electrical connector connected to a rechargeable battery 60 which allows the remote control 12 

25 to be plugged into a mating connector on a recharging power source device that is, for example, 
connected to a standard AC power outlet. 

Battery 60 can be a heavy component and thus may disadvantageous in an inertial 
haptic feedback device. The heaviness of the battery 60 can add to the overall mass of the 
device, which may weaken the strength of the inertial haptic sensations output by actuator 
30 assembly 50 and felt by the user. To compensate for this effect, a flexible or compliant coupling 
between the battery 60 and the housing 24. For example, a layer 62 of compliant foam can be 
placed between battery 60 and housing 24; other embodiments may use a rubber or other 
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compliant layer or spring element. Layer 62 allows the battery 60 to move at least partially 
independently of the housing 24, and thus inertially decouples the battery 60 from the housing 
24. The layer 62 reduces the inertial contribution of the battery 60 to the system and allows the 
user to feel stronger tactile sensations with the given actuator assembly 50 than if the battery 60 
5 were rigidly coupled to the housing without layer 62. 

FIGURE 3 is a perspective view of one embodiment 100 of the actuator assembly 50 for 
use in the remote control 12. Actuator assembly 100 includes a grounded flexure 120 and an 
actuator 1 10 coupled to the flexure 120. The flexure 120 can be a single, unitary piece made of a 
material such as polypropylene plastic ("living hinge** material) or other flexible material. 
10 Flexure 120 can be grounded to the mouse housing 24 of the remote control 12, for example, at 
portion 121. 

Actuator 1 10 is shown coupled to the flexure 120. The housing of the actuator is coupled 
to a receptacle portion 122 of the flexure 120 which houses the actuator 110 as shown. A 
rotating shaft 124 of the actuator is coupled to the flexure 120 in a bore 125 of the flexure 120 

15 and is rigidly coupled to a central rotating member 130. The rotating shaft 124 of the actuator is 
rotated about an axis B which also rotates member 130 about axis B. Rotating member 130 is 
coupled to a first portion 132a of an angled member 131 by a flex joint 134. The flex joint 134 
preferably is made very thin in the dimension it is to flex so that the flex joint 134 will bend 
when the rotating portion 130 moves the first portion 132a approximately linearly. The first 

20 portion 132a is coupled to the grounded portion 140 of the flexure by a flex joint 138 and the 
first portion 132a is coupled to a second portion 132b of the angled member by flex joint 142. 
The second portion 132b, in turn, is coupled at its other end to the receptacle portion 122 of the 
flexure by a flex joint 144. 

The angled member 131 that includes first portion 132a and second portion 132b moves 
25 linearly along the x-axis as shown by arrow 136. In actuality, the portions 132a and 132b move 
only approximately linearly. When the flexure is in its origin position (rest position), the 
portions 132a and 132b are preferably angled as shown with respect to their lengthwise axes. 
This allows the rotating member 130 to push or pull the angled member 131 along either 
direction as shown by arrow 136. 

30 The actuator 1 10 is operated in only a fraction of its rotational range when driving the 

rotating member 130 in two directions, allowing high bandwidth operation and high frequencies 
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of pulses or vibrations to be output. To channel the compression or stretching of the flexure into 
the desired z-axis motion, a flex joint 152 is provided in the flexure portion between the 
receptacle portion 122 and the grounded portion 140. The flex joint 152 allows the receptacle 
portion 122 (as well as the actuator 110, rotating member 130, and second portion 132b) to move 
5 (approximately) linearly in the z-axis in response to motion of the portions 132a and 132b. A 
flex joint 150 is provided in the first portion 132a of the angled member 131 to allow the flexing 
about flex joint 152 in the z-direction to more easily occur. 

By quickly changing the rotation direction of the actuator shaft 124, the 
actuator/receptacle can be made to oscillate along the z-axis and create a vibration on the mouse 

10 housing with the actuator 110 acting as an inertial mass. Preferably, enough space is provided 
above and below the actuator to allow its range of motion without impacting any surfaces or 
portions of the mouse housing 24. In addition, the flex joints included in flexure 120, such as 
flex joint 152, act as spring members to provide a restoring force toward the origin position (rest 
position) of the actuator 110 and receptacle portion 132. In some embodiments, the stops can be 

15 included in the flexure 120 to limit the motion of the receptacle portion 122 and actuator 110 
along the z-axis. 

FIGURE 4 is a perspective view of another embodiment 170 of an actuator assembly 50 
suitable for use in the remote control 12 to provide tactile sensations to the user. Actuator 
assembly 170 includes an actuator 176, such as a DC motor, which includes a shaft 172 that 
20 rotates about an axis C, and an eccentric mass 174 that is rigidly coupled to the shaft 172 and 
thus rotates with the shaft about axis C. In one embodiment, the housing of the actuator 176 is 
coupled to the housing of the remote control 12, e.g. the actuator can be attached to the inside of 
the housing of the remote control. In other embodiments, the actuator can be coupled to a 
movable manipulandum, such as a joystick or mouse, or other member. 

25 Many different types and shapes of eccentric masses 174 can be used. A wedge- or pie- 

shaped eccentric can be used, as shown, where one end of the eccentric is coupled to the shaft 
1 72 so that most of the wedge extends to one side of the shaft. Alternatively, a cylindrical or 
other-shaped mass can be coupled to the shaft 172. The center of the mass 174 is positioned to 
be offset from the axis of rotation C of the shaft 1 72, creating an eccentricity parameter that is 

30 determined by the distance between the axis of rotation of the shaft 172 and the center of mass of 
the mass 174. The eccentricity can be adjusted in different device embodiments to provide 
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stronger or weaker vibrations, as desired. Greater magnitude is generally obtained by changing 
the eccentricity if the motor is driven constantly in one direction. 

When the eccentric mass 1 74 is rotated by the motor 1 70, a vibration is induced in the 
motor and in any member coupled to the motor due to the off-balance motion of the mass. Since 
5 the housing of motor 176 is preferably coupled to a housing of the remote control 12, the 
vibration is transmitted to the user that is holding the housing. One or more of motors 176 can 
be included in a control 14 to provide vibrotactile or other haptic feedback; for example, two 
motors may be used to provide stronger magnitude vibrations and/or vibrations in two different 
directions. Other types of actuator assemblies may also be used, as disclosed in U.S. Patent No. 
10 6,184,868, such as a linear voice coil actuator, solenoid, moving magnet actuator, etc. 



Haptic Sensations 

Different types of haptic sensations can be output to the user in the local haptic 
sensation embodiment. Since the haptic sensations are determined based only on the local 
15 actions of the user on the remote control 12, the sensations can be based on specific actions or 
controls manipulated by the user. 

Engine vibration: The actuator assembly 50 can be controlled to output haptic 
sensations that are meant to simulate the vibration of an engine in a vehicle. This vibration 
sensation can have a magnitude and/or frequency correlated to the position of a throttle control, 

20 such as lever 20 in Fig. 1, which controls the speed of the toy 14. For example, as the forward 
speed of the toy is increased, the magnitude and frequency of the imparted vibration sensation is 
increased. At high speeds of the toy, a high magnitude and high frequency vibration can be 
imparted to the user, while at low speeds, a soft "idling" sensation can be imparted. When the 
user moves the lever 20 to command the toy to move in reverse, a unique haptic sensation 

25 associated with the reverse direction can be output, e.g. a lower frequency vibration. 

Turning: Haptic sensations can be controlled to be correlated with the user 
manipulating controls to turn the toy 14. For example, left-right lever 22 can be used to turn the 
toy left or right. In some embodiments, the amount of movement of the lever from the origin 
position controls the tightness of the turn; when the lever is fully left or right, the toy turns in its 
30 smallest turning radius. Vibrations can be output on the remote control 12 to indicate the 
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tightness of the turn. For example, a wide turn can be associated with a lower-frequency 
vibration, while a tight turn can be associated with a higher-frequency vibration. In some 
embodiments, both the speed and turn controls can be used in the determination of a haptic 
sensation. For example, a fast, tight turn can cause sporadic pulses as haptic sensations, which 
5 simulate the feel of tires of the toy losing traction with the ground. 

Other sensations: Other controls on the remote control 12 can be associated with haptic 
sensations. If there is a braking control that commands the toy to apply brakes or slow down its 
motion, a vibration can be output during the braking. Horns, blinking lights, or other functions 
of the toy controlled from the remote control 12 can also be associated with different haptic 
1 0 sensations. 

Kinesthetic force feedback can also be output on the controls of the remote control, 
which is forces in one or more of the sensed degrees of freedom of a manipulandum. For 
example, a motor or other actuator can output forces in the degree of freedom of lever 20 and 22, 
in the degree of freedom of motion of a button or switch, in the rotary degree of freedom of a 
15 small steering wheel or knob, etc. Some embodiments for providing such haptic feedback are 
described below with respect to Fig. 6. 

In a kinesthetic force feedback embodiment, time-based haptic effects can be output in 
the degree of freedom of a control, similar to the tactile effects described above. For example, a 
vibration or jolt can be directly output on the lever 20 or 22 while the user is holding it when 
20 controlling the toy 14 in a desired manner. The magnitude and/or frequency of the jolt or 
vibration can be based on the position of the control in its degree of freedom, and/or can simulate 
engine rumble, turning radius, etc. 

Furthermore, more sophisticated haptic sensations can be output in the kinesthetic force 
feedback embodiment. For example, a spring sensation generated by an actuator can provide a 

25 restoring force to a lever to its origin position. A tight or high-magnitude spring can be output 
for a fast turn of the toy 14, while a loose, low-magnitude spring can be output for a slow turn to 
simulate driving conditions at those speeds. Detents in the lever (or other control) motion can be 
output to mark particular positions to the user, e.g. each V% of the lever range moved provides a 
detent to let the user haptically know how fast he or she is controlling the car to move or how 

30 tight a turn is being controlled. The detents can be implemented as jolts, spring forces, or other 
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force profiles. A damping force can resist lever motion based on the velocity of lever motion. A 
barrier or obstruction force can prevent or resist motion of a control past a desired limit. 



Haptic Feedback Based on Information from the Controlled Toy 

5 

More sophisticated embodiments of the present invention are described below. In these 
embodiments, the toy 1 4 can send signals to the remote control 1 2 to inform the remote control 
of one or more statuses or conditions of the toy. The output of haptic sensations, and the 
characteristics of those haptic sensations (e.g., type of sensation, magnitude, frequency, duration, 
10 etc.), can be based solely or partially on these signals. 

In one embodiment, one or more sensors are mounted on the toy 14. For example, 
referring to Fig. 1, a sensor 32 can be mounted to the front bumper 33 of the car 14. When the 
car impacts or collides with an obstacle that is in the sensing range of the sensor 32, the sensor 
32 detects the collision and immediately relays status signals to the remote control 1 2 that the 
15 collision has occurred. In some embodiments, the sensor 32 can be an on/off sensor, detecting 
only whether a collision has occurred or not. In other embodiments, more sophisticated sensors 
can be used, such as analog sensors, which detect the strength of the collisions. 

The sensor 32 can be any of a variety of different types of sensors. For example, an 
optical sensor with emitter and detector, a magnetic sensor, a mechanical contact sensor, analog 
20 potentiometers that measure the motion of a contact member, or other types of sensors for 
detecting contact can be used. Alternatively, or additionally, one or more sensors can be 
positioned at other areas of the toy to detect contact in those areas, such as at a rear bumper or 
other rear surface, a side surface, the underside of the toy, etc. 

The signals sent from the toy 14 to the remote control 12 can have the same broadcast 
25 carrier frequency as the signals transmitted from remote control to toy, or can have a different 
frequency. The remote control 12, upon receiving the signal from the toy, can command a tactile 
sensation appropriate to the signal. 

A variety of haptic sensations can be provided. If a collision is detected by the sensor 
32, the controller (see Fig. 7) can command a jolt, pulse, or vibration to the housing of the 
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remote control. The user thus feels haptic feedback correlated to what the toy is experiencing. 
This can be not only more entertaining for the user, but also useful in a variety of contexts. For 
example, if the toy moves out of the sight of the user and collides with a wall, the user can be 
informed haptically and will know that the toy must be controlled in reverse to back away from 
5 the wall. If multiple sensors at different locations of the toy are being used, then a front collision 
can be associated with a different haptic sensation than a rear collision of the toy, a left side 
collision can be associated with a different haptic sensation than a right side collision, etc. For 
example, a front collision can be associated with a jolt or vibration having a high frequency 
and/or magnitude, while a rear collision can be associated with a jolt or vibration having a lower 

10 frequency and/or magnitude. If the remote control 12 includes multiple actuator assemblies 50, 
then the assemblies can be positioned in the remote control housing to correlate with locations 
on the toy. For example, one assembly can be positioned on the left side of the remote control, 
and the other assembly positioned on the right side. When the toy impacts something on its right 
side, the right actuator assembly can be controlled to output a jolt or vibration, so that the user 

15 feels a haptic sensation on the right side of the controller. 

In addition, the magnitude of the haptic sensations can be correlated with a speed of the 
toy that is assumed from the throttle control on the remote control 12. For example, if the lever 
20 has been pushed forward to its full extent, then it is assumed the toy is moving very fast and 
that when a collision occurs, it is a strong one. Thus, a high-magnitude jolt or vibration is 
20 output. If, on the other hand, the lever 20 is positioned only slightly away from its origin 
position when a collision is sensed by the sensor 32, a slow toy speed is assumed and a lower- 
magnitude sensation can be output on the remote control 12. 

In embodiments providing an analog sensor, force sensor, or variable-state sensor as 
sensor 32, different haptic sensations can be more realistically associated with different degrees 

25 of collision or contact as sensed by the sensors. For example, the sensor 32 can directly sense 
whether a collision is a strong one, and the magnitude of the correlated haptic sensation can be 
proportionally adjusted. Thus, a mid-strength collision can be associated with a haptic sensation 
having a magnitude in the middle of the available output range. This can provide a more 
realistic correlation between collision strength and haptic sensation strength, since a speed of the 

30 toy is not assumed, and an actual collision strength is measured. 

Haptic sensations can also be based on a combination of toy status, as relayed by the 
sensor(s) 32, and user manipulation of a manipulandum or control on the remote control 12. For 
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example, a centering spring force output in the degree of freedom of a steering wheel or knob on 
remote control 12 can be based on the current position of that wheel or knob, and can be 
combined with a jolt force that is output based on a sensed collision of the toy with another 
object. 

5 FIGURE 5 is a side elevational view of a toy vehicle 200 similar to the toy 14 of Fig. 1 , 

but has been modified to provide signals to the remote control 12. Toy 200 includes an inertial 
sensor 202 (e.g., an accelerometer) which can sense the accelerations to which the toy 200 is 
subject. 

Such inertial sensors can take a variety of different embodiments. For example, Inertial 
10 sensor 202 can be a lower-cost single-axis accelerometer that can measure accelerations in only 
one axis. This type of sensor can be placed to sense only front-back, top-bottom, or side-to-side 
accelerations, if desired. Alternatively, this type of accelerometer can be positioned in toy 200 at 
an angle, as shown in Fig. 5, so it can sense both vertical (top-bottom) and front-back 
accelerations. For example, placing the accelerometer at a 45-degree angle allows sensing in 
15 both these dimensions/axes (where a controller such as a local microprocessor can interpret the 
signals from the accelerometer to determine which accelerations are occurring in which 
dimensions). The sensor can be positioned at other angles to measure accelerations in other 
dimensions. In higjier-cost embodiments, multi-axis accelerometers can be used to provide 
separate signals for each sensed dimension. 

20 Use of the accelerometer allows the user to feel haptic sensations that can be correlated 

with a variety of interactions that the toy is experiencing. For example, the accelerometer can 
sense and send status signals and data to the remote control representative of accelerations on the 
toy indicating the toy is bouncing over rough terrain or down stairs, landing after jumping off a 
ramp, or sideswiping another toy or object. Different haptic sensations can be output on the 

25 remote control 12 which simulate or indicate all of these conditions on the toy. 

The accelerometer can also be used in conjunction with multiple actuator assemblies 50 
placed at different locations on the remote control 12, as described above. For example, sensed 
accelerations of the car in a front-back axis can cause actuator assemblies positioned at the front 
and back of the remote control 12 to output haptic sensations in correlation with the sensed 
30 accelerations. Left/right actuator assemblies can similarly provide left/right differentiation to the 
user. 
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FIGURE 6 is a perspective view of one example embodiment 230 for a kinesthetic 
force feedback implementation of the remote control 12. Up/down lever 20 is shown coupled by 
a shaft 234 to a rotary actuator 232, which can be a DC motor, for example, or other type of 
actuator. The actuator 232 can output forces in the rotary degree of freedom of the lever 20 as 
5 controlled by actuator signals from a local controller such as a microprocessor. In addition, a 
sensor can be coupled to the same shaft 234 to determine the position of the lever 20 in its 
degree of freedom. A similar actuator can be coupled to lever 22 to drive that lever in its left- 
right degree of freedom. 

Other embodiments can employ different types of actuators, such as voice coil 
1 0 actuators, moving magnet actuators, brushed or brushless motors, etc. Also, some embodiments 
can provide passive actuators that output a resistance on the lever, but cannot output an active 
force on the lever; such actuators include magnetic particle brakes, fluid brakes, or other brake- 
like devices. 

Other controls on the remote control 230 can be similarly provided with kinesthetic 
1 5 force feedback. Buttons, for example, can be coupled to actuators to output forces in the degree 
of freedom of the button, as disclosed in U.S Patent No. 6,184,868. Knobs, dials, linear sliders 
or switches, steering wheels, trackballs, direction pads, joysticks and other controls can also be 
actuated. 

Kinesthetic force feedback on the controls of the remote control can offer greater 
20 realism to experienced haptic effects. For example, spring forces can be output on the levers 20 
and 22 to provide a centering function without having to use mechanical springs. Furthermore, 
when the toy is moving faster, the spring magnitude can be controlled to be higher to simulate 
the increased road forces on the steering of the car. In addition, if a local sensor such as an 
accelerometer detects that the car is airborne, the spring magnitude can be made zero to simulate 
25 the feel of light steering when the car loses contact with the road. When the car is experiencing a 
bumpy or rough terrain, the accelerometers on the car can provide the data back to the remote 
control to cause vibration or other forces on the lever that simulates the bumpiness and may 
cause some difficulty to the user in steering the toy. 

FIGURE 7 is a block diagram illustrating a haptic feedback remote control device 12 and 
30 toy device 14 of the present invention. Remote control 12 and toy 14 can be any of the described 
embodiments herein. 



14 



WO 02/078810 PCT/US02/10394 

As explained above, toy device 14 can include electronic components for receiving 
signals and controlling motion of the toy. In some embodiments, the toy device 14 may include 
a processor 300, such as a microprocessor or other controller (hardware state machines, digital 
logic, an ASIC, etc.), which can receive sensor signals from sensor 32 (if a sensor is included on 
5 the toy) and which can output signals to control any output devices 302, such as motors that turn 
the front wheels for steering, wheel motors or other motors providing locomotion of the toy, any 
audio output devices such as a hom, and any visual output devices such as lights. In other 
embodiments, circuitry other than a processor 300 can be used for providing signals to output 
devices 302 and receiving signals from sensors 32 can be provided; for example, an analog 
10 control system can receive the signals from the remote control to drive the appropriate motors of 
the toy 14. An ASIC, state machines, or other logic can also be used. Any other required 
components for use with processor 300 may also be included, such as memory, I/O circuitry, etc. 

Processor 300 of the toy device 14 has a communication link 306 with the remote control 
device 12, as explained above. This link can be wireless through the use of RF or signals of 
15 other frequencies, or through a wire or other physical connection. In some embodiments, the 
link in one way, from the remote control device 12 to the toy 14. In other embodiments, the link 
is bi-directional. 

The haptic feedback remote control device 12 may include a local processor 310 which 
handles the input, output, and control functions of the remote control. The local processor 310 

20 can be provided with software (firmware) instructions to monitor the controls of the remote 
control device 12, wait for information sent from the toy device 14, and provide signals to the 
actuators of the remote control device to control haptic sensations. Processor 330 can include 
one microprocessor chip, or multiple processors and/or co-processor chips. In other 
embodiments, microprocessor 330 can include digital signal processor (DSP) functionality, or be 

25 implemented as control logic components, and ASIC, or hardware state machine instead of an 
actual microprocessor chip. 

A local clock 312 can be coupled to the processor 330 to provide timing data which 
might be required, for example, to compute forces output by actuators of the remote control 12. 
Local memory 314, such as RAM and/or ROM, can be coupled to processor 310 to store 
30 instructions for processor 310 and store temporary and other data. 
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Sensor interface 316 may optionally be included in device 12 to convert sensor signals to 
signals that can be interpreted by the processor 310. For example, sensor interface 316 can 
receive and convert signals from a digital sensor such as an encoder or from an analog sensor 
using an analog to digital converter (ADC). Such circuits, or equivalent circuits, are well known 
5 to those skilled in the art. Alternately, processor 310 can perform these interface functions. 

Sensors 318 sense the position, motion, and/or other characteristics of particular controls 
of remote control device 12; for example, sensors 318 can sense the motion or position of levers 
20 and 22 and any other buttons, switches, joysticks, trackballs, etc. on the remote control 12. 
Sensors 318 provide signals to processor 310 including information representative of that motion 
10 or position. Example of sensors suitable for embodiments described herein are analog 
potentiometers, Hall effect sensors, digital rotary optical encoders, linear optical encoders, 
optical sensors such as a lateral effect photo diode, velocity sensors (e.g., tachometers) and/or 
acceleration sensors (e.g., accelerometers). Furthermore, either relative or absolute sensors can 
be employed. 

15 Actuator interface 320 can be optionally connected between the actuators of remote 

control device 12 and processor 310 to convert signals from microprocessor 310 into signals 
appropriate to drive the actuators. Interface 320 can include power amplifiers, switches, digital 
to analog controllers (DACs), and other components well known to those skilled in the art. 

Actuators 322 transmit forces, as described above, to the housing of the remote control 
20 12 and/or particular controls 324 of remote control device 12 in one or more directions along one 
or more degrees of freedom in response to signals output by processor 310, i.e., they are 
"computer controlled/' Actuators 322 can include the actuator assembly 50 or rotary actuator 
234 described above. The actuators can a variety of devices, such as linear current control 
motors, stepper motors, pneumatic/hydraulic active actuators, a torquer (motor with limited 
25 angular range), magnetic particle brakes, friction brakes, or pneumatic/hydraulic passive 
actuators. 

Power supply 326 can be coupled to actuator interface 320 and/or to actuators 322 to 
provide electrical power to the actuator and other components of the remote control 12. As 
described above, power supply 326 is preferably batteries or other portable power supply. 

30 Other input devices 328 can be included in device 12 and send input signals to 

microprocessor 310. Such input devices can include other buttons, dials, knobs, switches, voice 
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recognition hardware, or other input mechanisms as described above. A safety or "deadman" 
switch can be included in some embodiments to provide a mechanism to allow a user to override 
and deactivate forces output by actuators 322. 

The operation of the system is now generally described. In the simpler, lower-cost 
5 embodiment, the sensors 318 can detect motion of controls such as levers 20 and 22 by the user 
and send the appropriate signals to the processor 310. The processor 310 then sends the 
appropriate control signals to the toy device 14 to control it in accordance with the user 
manipulation of the controls. The processor 310 also sends actuator signals to the actuator 
assembly(ies) 50 to output haptic sensations in accordance with the control manipulated and the 

10 way that control is manipulated. In the more sophisticated embodiments, the toy device 14 can 
send signals to the remote control 12. In those embodiments, the local processor 310 receives 
signals from local sensors 318 as well as information from the sensors 32 on the toy device 14. 
The local processor then determines the haptic sensations to be output and controls the actuators 
322 accordingly, as well as sending control signals to the toy device in accordance with the 

1 5 present user manipulation of the remote control 12. 

While this invention has been described in terms of several preferred embodiments, it is 
contemplated that alterations, permutations, and equivalents thereof will become apparent to 
those skilled in the art upon a reading of the specification and study of the drawings. 
Furthermore, certain terminology has been used for the purposes of descriptive clarity, and not to 
20 limit the present invention. It is therefore intended that the following appended claims include 
all such alterations, permutations and equivalents as fall within the true spirit and scope of the 
present invention. 

What is claimed is: 



17 



WO 02/078810 



PCT/US02/10394 



CLAIMS 



1 . A haptic feedback remote control device for providing control signals to a toy device 
to control the operation of said toy device, the control device comprising: 

5 a housing; 

at least one control for manual manipulation by said user, wherein said control signals 
representing said manipulation are sent to said toy device to control said operation of said toy 
device; 

an actuator coupled to said housing, said actuator outputting forces on said housing or 
1 0 said at least one control in response to received actuator signals, wherein said actuator moves an 
inertial mass to provide inertial haptic sensations on said housing, said inertial haptic sensations 
being felt by said user; and 

a controller electrically coupled to said actuator, said controller providing said actuator 
signals to said actuator and monitoring said control signals representing said manipulation of 
15 said at least one control, wherein said controller determines said actuator signals based at least in 
part on said manual manipulation of said at least one control by said user. 



2. A haptic feedback remote control device as recited in claim 1 wherein said controller 
determines said actuator signals based only on said manual manipulation of said at least one 

20 control by said user. 

3. A haptic feedback remote control device as recited in claim 1 wherein said control 
signals sent to said toy device are transmitted wirelessly to said toy device. 

4. A haptic feedback remote control device as recited in claim 1 wherein said controller 
determines said actuator signals also based on information received from said toy device. 

25 5. A haptic feedback remote control device as recited in claim 4 wherein said 

information received from said toy device includes information from a contact sensor on said toy 
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device, said information indicating whether said toy device has contacted with another object at a 
location of said contact sensor. 

6. A haptic feedback remote control device as recited in claim 5 wherein said 
information indicates a degree of contact of said toy device with said other object. 

5 7. A haptic feedback remote control device as recited in claim 4 wherein said 

information indicates an amount of acceleration experienced by said toy device in at least one 
dimension of said toy device. 

8. A haptic feedback remote control device as recited in claim 1 wherein said at least one 
control manipulated by said user includes a throttle control that determines a speed of travel of 

10 said toy device, wherein a magnitude of said forces is correlated with a setting of said throttle 
control. 

9. A haptic feedback remote control device as recited in claim 1 wherein said at least one 
control manipulated by said user includes a turning control that determines a direction of travel 
of said toy device, wherein a magnitude or frequency of said forces is correlated with a setting of 

1 5 said turning control. 

10. A haptic feedback remote control device as recited in claim 1 wherein said toy 
device is a toy vehicle capable of moving. 



1 1. A haptic feedback remote control device for providing control signals to a toy device 
20 to control the operation of said toy device, the control device comprising: 

a housing; 

at least one control for manual manipulation by said user, wherein said control signals 
representing said manipulation are sent to said toy device to control said operation of said toy 
device, wherein said at least one control includes a throttle control that determines a speed of 
25 travel of said toy device; 

an actuator coupled to said housing, said actuator outputting forces on said housing or 
said at least one control in response to received actuator signals; and 
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a controller electrically coupled to said actuator, said controller providing said actuator 
signals to said actuator and monitoring said control signals representing said manipulation of 
said at least one control, wherein said controller determines said actuator signals based at least in 
part on said manual manipulation of said at least one control by said user, and wherein a 
5 magnitude of said forces is correlated with a setting of said throttle control. 

12. A haptic feedback remote control device as recited in claim 11 wherein said 
controller determines said actuator signals based only on said manual manipulation of said at 
least one control by said user. 

10 13. A haptic feedback remote control device as recited in claim 11 wherein said 

controller determines said actuator signals also based on information received from said toy 
device. 

14. A haptic feedback remote control device as recited in claim 13 wherein said 
information received from said toy device includes information from a contact sensor on said toy 

15 device, said information indicating whether said toy device has contacted with another object at a 
location of said contact sensor. 

15. A haptic feedback remote control device for providing control signals to a toy device 
to control the operation of said toy device, the control device comprising: 

20 a housing; 

at least one control for manual manipulation by said user, wherein said control signals 
representing said manipulation are sent to said toy device to control said operation of said toy 
device; 

an actuator coupled to said at least one control, said actuator outputting forces on said 
25 housing or said at least one control in response to received actuator signals; and 

a controller electrically coupled to said actuator, said controller providing said actuator 
signals to said actuator and monitoring said control signals representing said manipulation of 
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said at least one control, wherein said controller determines said actuator signals based at least in 
part on information received from said toy device. 

16. A hap tic feedback remote control device as recited in claim 15 wherein said 
5 controller determines said forces based at least in part on said manual manipulation of said at 

least one control by said user. 

17. A haptic feedback remote control device as recited in claim 15 wherein said actuator 
outputs inertial forces on said housing by moving an inertial mass. 

18. A haptic feedback remote control device as recited in claim 15 wherein said at least 
10 one control includes a lever movable in one degree of freedom, wherein said actuator outputs 

forces in said degree of freedom. 

19. A haptic feedback remote control device as recited in claim 15 wherein said 
controller determines said forces also based on information received from said toy device. 

20. A haptic feedback remote control device as recited in claim 19 wherein said 
15 information received from said toy device includes information from a contact sensor on said toy 

device, said information indicating whether said toy device has contacted with another object at a 
location of said contact sensor. 

21. A haptic feedback remote control device as recited in claim 19 wherein said 
information indicates an amount of acceleration experienced by said toy device in at least one 

20 dimension of said toy device. 

22. A haptic feedback remote control device as recited in claim 15 wherein said toy 
device is a toy vehicle capable of moving. 

23. A haptic feedback remote control device for providing control signals to a toy device 
25 to control the operation of said toy device, the control device comprising: 

housing means; 
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at least one control means for manual manipulation by said user, wherein said control 
signals representing said manipulation are sent to said toy device to control said operation of said 
toy device; 

actuation means for outputting forces on said housing means or said control means in 
response to received actuator signals; and 

control means for providing said actuator signals to said actuator and for monitoring said 
control signals representing said manipulation of said at least one control, wherein said controller 
determines said actuator signals based at least in part on said manual manipulation of said at 
least one control means. 

24. A haptic feedback remote control device as recited in claim 23 wherein said control 
means determines said actuator signals also based on information received from said toy device. 

25. A haptic feedback remote control device as recited in claim 23 wherein said control 
means determines said actuator signals only based on said manual manipulation of said at least 
one control means. 

26. A haptic feedback remote control device as recited in claim 23 wherein said 
information received from said toy device includes information from contact sensor means on 
said toy device, said information indicating whether said toy device has contacted with another 
object at a location of said contact sensor means. 

27. A remote control toy device providing haptic feedback to a user, the toy device 
comprising: 

a remote control unit for providing control signals, said remote control unit including: 
a housing, 

a control manually manipulable by said user, 

an actuator coupled to said housing, said actuator outputting forces on said 
housing or on said control in response to received actuator signals, and 
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a controller operative to provide said actuator signals to said actuator and to 
monitor said control signals representing said manipulation of said at least one control; 
and 

a toy device operable to physically move in accordance with said control signals received 
5 from said remote control unit. 

28. A remote control toy device as recited in claim 27, wherein said controller 
determines said actuator signals based at least in part on said manual manipulation of said 
control. 

10 29. A remote control toy device as recited in claim 27 wherein said toy device further 

includes a sensor for determining an interaction or action of said toy device, wherein information 
representative of said interaction or action is sent to said remote control unit. 

30. A remote control toy device as recited in claim 29 wherein said sensor detects 
contact of said toy device with another object, wherein said information informs said remote 

1 5 control unit of said contact. 

31. A remote control toy device as recited in claim 30 wherein said sensor detects a 
degree of contact of said toy device with another object, wherein said information informs said 
remote control unit of said degree of contact. 

32. A remote control toy device as recited in claim 29 wherein said sensor is an 
20 accelerometer that detects an acceleration on said toy device, wherein said information informs 

said remote control unit of said acceleration. 

33. A method for controlling a toy device based on manipulation of a remote control unit 
by a user and for providing haptic sensations to the user, the method comprising: 

25 providing control signals to said toy device based on manual manipulation of at least one 

control on said remote control unit by said user, wherein said control signals control the 
operation of said toy device; 
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receiving status signals from said toy device, said status signals indicating a current status 
of said toy device; and 

causing haptic sensations to be output on said remote control unit, said haptic sensations 
based on at least one of said manual manipulation of said at least one control and said status 
signals received from said toy device. 



34. A method as recited in claim 33 wherein said actuator moves an inertial mass to 
provide inertial haptic sensations on a housing of said remote control unit. 

35. A method as recited in claim 33 wherein said at least one control includes a lever 
movable along an axis. 

36. A method as recited in claim 33 wherein said control signals sent to said toy device 
and said status signals received from said toy device are communicated wirelessly. 

37. A method as recited in claim 33 wherein said status signals received from said toy 
device include information from a contact sensor on said toy device, said information indicating 
whether said toy device has contacted with another object at a location of said contact sensor. 

38. A method as recited in claim 33 wherein said status signals received from said toy 
device include information indicating an amount of acceleration experienced by said toy device 
in at least one dimension of said toy device. 
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